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A  NEW  DISTRIBUTE)  ROUTING  PROTOCOL 


1.0  nmocucricN 


Rtseardi  is  being  conducted  at  the  Oerter  for  Systems  Engineering  and 
Integration  of  CECDH,  Fort  Mornouth,  NJ,  to  develop  a  distributed  routing 
and  resource  allocation  protocol  fcr  use  in  digital  radio  broadcast 
networks.  Althcucpi  the  crigiml  activation  fcr  the  research  was  to  develop 
a  new  distributed  routing  protocol  for  real  tine  use  to  achieve  autosated 
shortest -path  routing  and  optima)  resource  distribution  in  a  battlefield 
<feta  distribution  system,  the  research  effort  has  evolved  into  developing 
effective  computer  assisted  capabilities  and  techniques  for  use  by  the 
network  re  eager.  The  present  goal  of  our  ongoing  research  is  to  sapiens  the 
possibility  of  meeting  the  baseline  for  the  aesputer  assisted  capabilities 
and  techniques  referred  to  in  the  concluding  section  of  the  Joirt.  Tactical 
Internet  ion  Distribution  System  Planning  Guide  [1]. 

This  chapter  introduces  the  reactor  to  the  two  basic  battlefield  data 
distribution  system  concepts:  ooBBunication  and  network 

connectivity.  The  parameters  and  the  established  protocols  that  we  will  be 
dealing  with  are  those  of  a  typical  battlefield  data  distribution  system 
considered  for  future  deployment. 


1.1  Needlines 

A  Headline  is  a  directed  (one  way)  virtual  lirk  required  between  a  message 
origination  point  (source)  and  a  message  destination  point  (sink). 

Ocnputing  the  neximum  number  of  needlines  possible  in  a  network  is 
equivalent  to  computing  the  anximsn  nunber  of  directed  virtual  lilies 
possible  in  a  network  of  nodes. 

A  network  can  be  represented  by  an  undirected  graph  G(V,E)  where  V  is  a  set 
of  vertices  (or  nodes)  and  E  is  a  set  of  edges  (or  undirected  links) .  if 
there  are  two  vertices  in  V,  an  edge  is  passible  in  E,  and  if  there  are 
three  vertices  in  V,  it  is  possible  to  have  up  to  3  edges  in  E.  The  saxieian 
nunber  of  possible  edges  in  E  given  V  is  equivalent  to  the  total  nuafcer  of 
pairwise  oonbi  net  lore  of  the  vertices  in  V.  Therefore, 

the  reximan  umber  of  possible  edges  *  (£)  =  nl/(n-2)12l  =  n(n-l)/2. 

(An  edge  represents  an  undirected  lirk,  or  equivalently,  two  directed  links 
directed  in  opposite  directions. }  We  can  conclude  by  substitution  that 
there  are  n(n-l)  needlines  possible  in  ary  given  network  requiring 

need! ires. 
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Table  1-1.  Nodes  vs.  Needlines 


The  maxinun  nunber  of  passible  needlines  far  a  given  network  can  be 
tabulated.  Table  1-1  shows  a  quadratic  increase  in  the  lmxinum  nunber  of 
possible  needlines  with  respect  to  a  linear  increase  in  the  nunber  of  nodes 
present. 


In  typical  military  applications  we  find  an  average  of  3  to  5  needlines 
associated  with  a  node.  This  is  due  to  the  hierarchical  architecture  of 
centner*?  and  control  where  typically  3  to  5  subordinate  units  actively 
oonunicate  with  a  corner*?  and  control  center. 


1 .2  Connectivity 

Under  the  ideal  conditions  of  propagation  in  free  space  and  no  physical 
obstructions,  line-of-sic^t  operations  are  possible  between  all  pairs  of 
nodbs.  However,  when  nodes  are  tactically  deployed  in  an  enviirn— nt  with 
irregular  terrain  and  dense  foliage,  large  signal  attenuation  (typically  > 
140HB  £25Rn)  and  conplete  outages  (loss  of  line-of-eic^it)  can  be  epseted. 

Relays  are  required  to  route  nessages  when  a  direct  line-of-si^it  operation 
is  unrealizable.  A  node  can  serve  as  a  relay  if  them  exists  a 
line-of-sicht  to  the  node.  However,  there  are  lire-af -sight  connections 
which  have  hi<£>  message  error  rates  dhe  to  emriroraetbal  conditions.  Them 
are  also  line-of-si<£it  connect  ions  to  nodes  possessing  hiepi  sassage  delays. 
As  we  can  see,  all  lire-of-sight  connect  ions  cannot  be  considered  to  be 
equal  in  deciding  the  best  path  to  satisfy  a  medline,  and  the  varieties*  in 
the  parameters  nust  be  taken  into  account. 

Network  connectivity  influences  the  network  capacity  mquimasflt,  the  rath 
that  is  taken  to  satisfy  a  needline,  and  the  likelihood  of  a  madltm  being 
satisfied.  There  fere,  network  connectivity  is  an  ixpcrtartt  parsastar  that 
needs  to  be  quantified. 

Silvester  and  Kleinrock  f9]  define  the  degree  of  a  nods  as  the  amber  of 
ooanunioart.s  of  the  node.  But  they  also  define  a  node  as  a  o— dcut  of 
itself.  He  will  sixply  define  the  degree  of  a  node  as  the  ruber  of 
comminicarfcs  of  the  node,  not  counting  itself  as  its  oo—unioaib.  The 
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degree  of  a  node  is  defined  as  the  total  umber  of  edges  (or  arts)  Which 
cxxqxLe  the  node  to  the  network. 

Representing  a  network  ty  the  undirected  graph  G(V,E),  the  average  degree 
far  a  network  is  the  ranter  of  edges  in  E  divided  by  the  ranker  of  vertices 
in  V,  or  average  degree  =  Etedges /vertex] .  The  average  degree  gives  an 
indication  of  the  connectivity  of  the  network. 

A  radio  network  operating  in  a  heavily  vegetated  enviroment  is  likely  to  he 
sparsely  connected,  and  the  sparse  connectivity  nay  be  reflected  by  a  low 
average  degree.  There  are  sene  very  inpartant  problems  encountered  in  such 
an  environment.  The  next  two  sections  investigate  the  problems  associated 
with  sparsely  connected  networks. 


1 .2.1  A  Disconnected  Network 


Figure  1-1 .  Disconnected  Network 


A  network  in  which  every  node  is  connected  to  at  least  one  other  node  is  not 
necessarily  fully  connected,  in  Fig.  J-l  we  see  a  disconnected  network  of 
six  nodes,  each  node  possessing  a  degree  of  2 .  Coonunicaf  ions  between  the 
nodes  in  the  group  [A,B,C]  and  the  nodes  in  the  group  [D,E,F]  are  not 
feasible.  In  general,  given  a  fixed  average  degree,  the  probability  of  a 
disconnected  network  occurring  increases  with  the  increase  in  the  timber  of 
nodes  in  the  network. 


Figure  1-2.  Sparse ly  Connected  Network 
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A  network  operating  in  an  envirocment  of  wxying  terrain  conditions  any  have 
local  variations  in  its  network  connectivity.  The  nodes  operating  in  areas 
of  sparse  connectivity  nay  encounter  problems  of  bottle  recking. 

The  network  in  Fig.  1-2  is  fully  connected  because  each  node  can  have  a  path 
to  ary  other  node.  However,  all  cocmuni  cat  ions  between  nodes  A,B,C,and  D 
and  nodes  E,F,G,and  H  nust  occur  through  link  1  which  connects  nodes  B  and 
H.  Lirk  1  is  where  bottlenecking  is  likely  to  occur.  A  possible  solution 
to  the  problem  is  to  provide  a  lire  -of  -s  ight  operation  between  nodes  A  and 
E,  and  between  nodes  C  and  G. 


1.2.3  Connectivity  Quality 

The  connectivity  quality  (GQ)  of  a  liik  is  represented  by  an  M-ary  GQ  symbol 
which  requires  a  field  of  log2(M)  bits.  To  enable  the  exchange  of  a  large 
runber  of  OQ's  with  ndniitum  overhead  capacity,  H  nust  be  a  snail  timber. 
Letting  M=4,  only  2  bits  per  directed  liik  are  required,  for  which  we  assise 
the  following  qualification: 

0  =  very  high  probability  of  transmission  error 

1  =  high  probability  of  transmission  error 

2  =  medium  probability  of  transmission  error 

3  =  low  probability  of  transmission  error. 


® - (D - © - (§) 

Figure  1-3.  Route  Between  Nodes  A  and  D 


Suppose  there  is  a  reed  to  transmit  one  hundred  message  blocks  from  node  A 
to  node  D.  The  route  chosen  to  satisfy  the  reed  is  illustrated  in  Fig.  1-3. 
The  connectivity  qualities  of  interest  are 

CQ(A,B)  =  3  CQ(B,C)  =  2  CX3(C,D)  =  1 

for  which  we  assure  the  following  quantification: 

CQ(i, j)  =  3  implies  Pe  <  101 

CQ(i,  j)  =  2  iitplies  Pe  <  20% 

OQ(i, j)  =  1  implies  Pe  <  40% 

0Q( i,  j)  =  0  implies  Pe  <  €0% 

The  absence  of  OQ(i,  j)  in  a  message  implies  Pe  >  60% 


i 

i 

■I 

i 


The  probability  that  the  transmission  from  node  A  to  node  D  is  successful 
is: 


Pc  =  (1.0  -  0.1)  x  (1.0  -  0.2)  x  (1.0  -  0.4)  =  0.432 

Assuming  a  perfect  beck  charnel  and  that  automatic  repeat  requests  occur 
only  at  message  destination  points  (node  D  in  this  exanple),  it  takes  an 
average  of  236  message  blocks  to  deliver  100  aorxect  message  blocks  through 
a  channel  that  has  0.568  probability  of  transmission  error.  Naturally,  with 
an  imperfect  back  channel,  this  number  would  be  hi<£ier. 


1.2.4  Asymmetric  Connectivity 

Par  distributed  digital  radio  networks,  the  connectivity  of  a  node-to-node 
connection  carrot  be  assuned  to  be  symnetric.  There  are  two  different  cases 
that  illustrate  this  point: 


Case  ] : 
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Figure  1-4.  Undirected  Lirk 


Par  the  network  in  Fig.  1-4,  link  A-B  is  an  undirected  lirk,  but  the 
connectivity  quality  OQ(A,B)  is  2  and  the  connectivity  quality  GQ(B,A)  is  3. 
The  lirk,  then,  is  an  undirected  lirk  with  asymmetric  ex  -tivity 

qualities.  The  asymnetry  can  be  due  to  unequal  transmit  ,  powers, 

different  antenna  heights  and/or  directivity,  and  unequal  proximities  of 
mbs  A  and  B  to  a  wide  variety  of  interfere  rs. 


Figure  1-5.  Directed  Lirk 

For  the  network  in  Fig.  1-5,  the  connectivity  quality  OQ(A,B)  is  3.  but 
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OQ(B,A)  is  absent  in  the  (direct )  ooununicart  status  messages.  There  fere, 
we  can  say  that  the  lirk  is  a  directed  lirk  which  allows  co—uni  cations  only 
from  node  A  to  node  B. 


2.0  ISSUES  IN  DISTRIBUTED  ROUTING 


A  variety  of  retwrt  control  schemes  (aerfcra  lined,  hierarchical,  and  fully 
distributed)  can  be  used  in  a  digital  broadcast  network,  but  for  erhansd 
survivability  under  battlefield  conditions  a  distributed  network  control 
scheme  is  considered. 

Some  distributed  routing  schemes  have  been  proven  very  successful  in 
government  and  oosmerdal  applications  (ARPANET,  slotted  ALOHA,  etc. ),  but 
because  of  various  constraints  associated  with  a  digital  broadcast  network 
tmiy  cosputer  oriented  distributed  routing  algorithms  are  not  applicable  for 
use  in  battlefield  data  distribution  systems.  The  algorithms  that  an  being 
studied  for  applicability  to  the  network  samgemert  of  a  battlefield  data 
distribution  system  are  the  Merlin-Gagall  protocol,  Brasble  Haryk  algorithm, 
and  repromulgation  relay  routing. 

This  chapter  investigates  the  various  issues  in  distributed  routing.  The 
three  key  issues  which  we  will  investigate  are:  failsafe  routing, 
minimization  of  control  nes sages,  and  improving  the  network  response  time. 

We  will  explore  these  issues  ty  citing  the  key  properties  of  the  various 
algorithms  last  nertioned. 


2.1  Failsafe  Routing 

The  WTO  report,  "A  Surrey  of  Routing  Algorithm  for  Distributed  Digital 
Radio  Networks"  [2],  states  that: 

1)  "A  aonmon  type  of  algorithm  uses  a  distance  matrix  at  each  node...." 

2)  "At  times  specified  by  the  particular  scheme  used,  a  node  sands  to 
its  neighbors  its  minium  distance  table,  in  whole  or  in  part. 

The  nei^ibor  uses  this  ndnimsn  distance  inform  ion  to  update  its 
own  distance  natrix." 

Thus,  the  distance  exchange  additive  procedure  described  above  requires  a 
node  to  create: 

1)  a  distance  natrix; 

2)  a  minimi  distance  table; 

3)  a  routing  table. 

A  typical  distributed  routing  algorithm  would  require  that  each  node  acquire 
a  global  knowledge  of  the  distances  by  iterating  the  distance  exchange 
additive  procedure  until  a  net  steady  stats  is  reached. 


0 - 0 - © 

Figure  2-1 .  Linear  Network  of  3  Nodes 


A  distributed  routing  failure  can  be  illustrated  with  the  use  of  the 
distance  exchange  additive  procedure.  Consider  the  network  in  Fig.  2-1. 

Node  A  needs  to  route  a  nessage  to  node  C.  Node  £  infcnje  node  A  that  node 
C  is  one  hop  away  from  node  B .  Nods  A  determines  that  it  takes  two  hops  to 
route  the  message  to  node  C,  and  that  the  first  hqp  is  to  node  B.  Node  A 
sends  the  message  to  its  preferred  neighbor,  node  B.  At  the  instant  node  B 
receives  the  message,  the  lirk  B-C  fails.  Nods  B  broadcasts  the  infinity 
distance  to  node  C.  Node  A  receives  the  broadcast,  but  the  nessage  is 
discarded  because  its  present  minimum  distance  tahle  entry  is  less  than 
infinity.  Nods  B  is  informed  that  node  A  can  achieve  the  routing  in  two 
heps.  Node  B  enters  the  distance  to  node  C  as  three  heps  and  sends  the 
message  to  node  A.  From  this  point  on  node  A  believes  the  2  heps  distance 
to  node  C,  and  node  B  believes  the  3  heps  distance  to  node  C,  and  the 
nessage  loops  between  node  A  and  node  B. 

There  exists  a  routing  failure  (looping)  if: 

1)  The  runtoer  of  times  that  a  nessage  has  hepped  equals  or 
exceeds  the  total  ranter  of  nodes  present. 

2)  The  distance  to  the  sirk  does  not  decrease  after  a  hqp. 

One  way  to  awid  looping  is  to  implement  the  concept  of  a  directed  spanning 
tree  in  the  routing  algorithm.  Merlin  and  Sega  11  [3]  produced  a  failsafe 
protocol  which  uses  the  directed  spanning  tree  concept  .  The  algorithm  can 
be  employed  in  packet  message  as  well  as  circuit  switching  networks.  It 
uses  distributed  computation,  provides  routing  tahles  that  are  loop-free  for 
all  destinations  at  all  tines,  adapts  to  changes  in  network  flows,  and  is 
completely  failsafe.  Because  a  conplete  description  of  the  protocol  is 
rather  involved  the  reader  is  referred  to  the  original  publication  [33  or  to 
the  detailed  application  study  done  fcy  MIHE  Corp.  [63 . 

Another  distributed  routing  algorithm  that  is  failsafe  (reliable)  is  the 
repxcnulgation  relay  algorithm.  The  algorithm  does  not  really  route 
nessac^s  because  it  uses  the  method  of  flooding  (cascading).  Each  massage 
is  distributed  throughout  the  network,  and  if  there  is  a  connectivity 
between  the  message  destination  node  and  the  rest  of  the  network,  the 
massage  is  guararteed  to  be  delivered. 

A  study  of  the  use  of  repromulgetion  relay  for  JTIDS  was  aonducted  by  the 
MTOE  Oorp.  [11] .  The  report  used  the  baseline  conditions  used  in  the 
simulations  by  the  Rubies  Aircraft  Co.  [12]  for  RJH  performance  evaluation. 
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The  report  projected  that  152  TS/S  (timeslots  per  second)  in  tines  Lot 
capacity  are  reetted  to  satisfy  the  total  throughput  requirement.  This 
exceeds  the  J 28  TS/S  capacity  available  on  one  net. 

An  obvious  solution  to  the  problem  is  to  use  more  than  one  net  to  satisfy 
the  total  capacity  require  mart .  Two  schenes  were  proposed:  divide  the 
divisional  JTIDS  participants  into  three  functional  nepromulgption 
communities,  ex*  into  five  geographic  oonnunit ies .  The  functional 
comtinit  ies  scheme  has  a  serious  shortcoming  in  that  “local  connectivity  nay 
cause  a  terminal  or  group  of  terminals  to  be  isolated  from  its  community 
even  thouepi  the  ore  rail  connectivity  for  the  area  would  seem  to  allow  for 
full  local  connectivity"  [11].  This  leaves  the  geographic  grouping  scheme 
for  consideration. 

In  the  geographic  grouping  scheme,  the  JTIDS  crxmunities  are  carefully 
defined  so  that  most  cornua ni cat  ions  are  confined  to  within  each  oomninity. 
Intercommunity  "gateway"  allocations  do  exist  but  are  ndnimdned  far  better 
timeslot  resource  utilization. 

The  repram  1  gat  ion  relay  algorithm  is  reliable,  but  as  reported,  it 
necessitates  the  use  of  several  nets  to  satisfy  the  total  cape  dty 
requirement  for  a  division-sized  JTIDS  community.  What  would  be  ideal  is  to 
hare  a  reliable  routing  algorithm  that  would  allow  far  the  possibility  of 
*he  use  of  a  single  net  to  satisfy  the  total  capacity  requirement. 

An  investigation  of  an  optimal  approach  for  timeslot  allocation  was 
conducted  [10].  The  paper  indicates  that  there  is  the  possibility  of  a 
concurrent  use  of  tineslots  by  the  transmitters  in  the  same  net.  The 
reprcmulgation  relay  algorithm  does  not  allow  far  the  use  of  the  optimal 
approach  for  timeslot  allocation. 


2.2  Message  Volume 

One  of  the  important  issues  in  distributed  routing  is  minimizing  the  control 
messages  generated  far  routing.  A  proliferation  of  control  messages  not 
only  depletes  the  network  capacity,  but  also  creates  unnecessary  message 
traffic  congestion  which  may  lead  to  a  network  failure. 

Capitalizing  on  the  hierarchical  nature  of  tactical  networks  which  tend  to 
constrain  needlines  to  local  nets  within  a  global  network.  Bramble  and  Mayk 
[4]  took  a  unique  approach  in  developing  a  distributed  routing  algorithm.  A 
limited  volume  of  control  messages  is  generated  locally  to  communicate  the 
connectivity  status  information  necessary  to  satisfy  the  needlines 
associated  with  each  pair  of  message  origination  and  destination  paints. 
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The  algorithm  works  as  follows:  A  nosaatp.  - twutoe),  in 
its  attcspt  to  locate  its  message  dBttiml  urn  pniit  (tiife),  amentias  thoau^t 
its  term  ml  connectivity  matrix  (TOO  ter  the  sit*  Typtnlly,  a  YGH  only 
imintaine  the  connectivity  quality  (00)  ertiria*  «»»  the  amuracatts  that  axe 
within  two  hqps  of  the  node  holding  the  TO*.  it  the  auuiu-  das  not  find 
its  sink,  it  sends  its  direct  aomirdcarts  a  Wva  1  S  ouesarct  ivity 
irterrogat ion  nessage.  Upon  receiving  tlas  irterroqmt  ton  massage,  each 
direct  aosnunicart  searches  throuch  its  TCM  far  the  sii*.  Of  oauxme,  if  the 
siric  is  further  than  three  heps  frost  the  source  no  direct  op— intern*  will 
find  the  siric  in  its  7CM. 

When  the  source  does  not  receive  a  connectivity  status  massage  within  a 
given  period  of  tine,  it  generates  a  level  1  connectivity  interrogation 
nessage  in  an  attenpt  to  broaden  the  search  radius  to  4  heps.  The  direct 
ocxmunicarts  of  the  source  receive  the  level  1  interrogation  nessage,  and 
each  takes  on  the  function  of  level  0  interrogators.  The  level  0 
irterrogat  ions  are  then  received  by  the  direct  ocnnunioMts  of  the  level  0 
interrogators,  but  are  processed  only  by  those  who  are  not  already 
participating  in  the  search.  Therefore,  implicit  in  the  algorithm  is  the 
use  of  the  ndnimnn  spanning  tree,  with  a  flag  of  one  kind  or  another 
indicating  the  nodes  belonging  to  a  minimum  spanning  tree.  If  the  sink  is 
located  many  heps  away  from  the  source  then  sequenced  connectivity 
interrogation  messages  of  increasing  levels  axe  broadcast  by  the  source 
until  the  first  connectivity  status  nessage  is  received. 

The  upper  bound  on  the  capacity  consumed  by  the  interrogation  process  in 
satisfying  a  needline  is 

TS(r)  =  2[l+2+3*. .  .+(r+l)], 

where  r  is  the  nmber  of  relays  in  the  route.  Using  the  identity, 

[the  sum  of  i  from  i=l  to  i=m]  =  m(nrt-l)/2, 
we  can  restate  the  above  relationship  as 

TS(r)  -  (r+l)(r+2), 
where  we've  substituted  r+1  for  m. 

When  alternate  routes  are  also  considered,  the  capacity  oonswed  by  the 
irterrotyit ion  process  is  less  than  or  equal  to  s(r+l)(r+2),  where  a  is  the 
timber  of  alternate  routes  required. 

Given  n=50,  s=2,  E[r>6,  and  E[NL/n}=5,  where  n  is  the  runber  of  nodes  and 
NL/n  is  the  number  of  needlines  originating  from  a  node,  28,000  TS  axe 
oonmmed  by  the  interrogation  process.  Sins  there  are  128  TS  per  second, 
we  find  that  it  takes  3.7  mi  rotes  car  less  to  initialise  the  network. 
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To  correctly  est irate  the  initialization  tine  far  a  network,  the  parameters 
of  the  network  mist  he  correctly  assessed.  Moquillan,  Richer,  and  Rosen 
observed  in  their  ARPANET  study  [5]  that  "although  there  Eire  sites  an  the 
ARPANET  separated  by  as  nary  as  11  heps,  about  one-third  of  the  Messages  in 
the  network  travel  no  more  than  one  hep;  about  half  travel  no  mote  than 
three  heps".  Furthermore,  a  MTOE  working  paper  [6]  projects  the  average 
runter  of  heps  per  needline  far  a  FJH  network  to  be 

Efhcps/NL]  given  40  nodes /network  =  2 

EChcps/NL]  given  250  nodes/network  =  3. 

Far  sost  networks  it  is  clear  that  the  nunter  of  heps  expected  to  satisfy  a 
needline  is  rather  snail.  Under  this  assumption  the  Branfcle-Mayk  algorithm 
should  perform  well.  For  the  algorithm,  global  inf  carnation  sharing  is  not 
required,  and  the  timber  of  connectivity  interrogations  is  minimized  by  Hie 
reception  of  regular  broadcasts  of  (direct)  cocnunicart  status  messages. 


2.3  Network  Response  Time 

The  response  tine  of  a  network  is  defined  as  the  amount  of  ti  a  required  for 
network  infarration  such  as  topological  changes,  new  needline  requirements, 
routing,  and  the  like  to  propagate  thrcu^i  the  network  and  reach  a  new 
steady  state. 

Sene  routing  algorithms  propagate  update  messages  throuejiout  the  network 
when  a  topological  change  occurs.  When  an  update  message  is  propagated, 
transient  loops  ray  develop.  An  example  of  a  routing  algorithm  that  is 
susceptible  to  prolonged  transient  loops  is  the  original  routing  algorithm 
for  the  ARPANET.  The  algorithm  uses  the  distance  exchange  additive 
procedure  where  distance  infarration  is  not  only  shared  node-to-node  but  is 
processed  by  the  receiving  node  before  it  is  ready  to  broadcast  the  message. 
Although  the  algorithm  has  safeguards  against  permanent  loops,  transient 
loops  were  observed  to  exist  for  prolonged  periods.  Tie  new  routing 
algorithm  for  the  ARPANET  [5]  floods  the  network  with  update  messages  which 
travel  unchanged  to  all  nodes  in  the  network.  Inforration  is  shared 
globally  and  rapidly,  minimizing  the  durations  of  the  transient  loeps. 

The  average  length  of  an  upefate  nessage  is  176  bits  for  the  new  routing 
algorithm  oonpared  to  1200  bits  for  the  original  routing  algorithm.  The 
upihte  rate  is  less  than  two  updates  per  second  per  link  for  the  new  routing 
algorithm  oorpared  to  the  rates  far  tlie  arigiral  routing  algorithm  which  can 
b»  a.  hitfi  as  seven  updates  per  second  per  link.  It  takes  an  the  order  of 
INhs  for  all  nodes  to  respond  to  a  topological  change  using  the  new  routing 
algorithm. 
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Moguillan,  Richer,  and  Rosen  [53  attribute  the  shorter  response  tine  to 
using  local  oocputation  instead  of  the  global  confutation  used  by  the 
original  routing  algorithm  for  the  ARPANET.  Global  cxeputat ion  at  ary 
instant  depends  more  on  the  history  of  events  around  the  network  than  on  the 
traffic  in  the  network  at  that  time.  But  for  the  local  rrapitat- im,  because 
information  distribution  and  information  processing  are  independent 
processes,  the  traffic  in  the  network  is  more  accurately  conveyed  to  all 
nodes  with  mininum  delay.  For  these  reasons  local  oocputation  is  better 
than  distributed  global  oocputation. 


3.0  BASIC  HDUTIiC  PROTOCOL 


Tte  basic  routing  protocol  (BRP)  works  as  follows:  A  mini  mm  spanning  tree 
is  grown  from  a  message  origination  pair*  (source)  until  the  message 
destination  point  (sir*)  is  found.  The  path  between  the  source  and  the  side 
found  in  the  minimum  spanning  tree  is  the  shortest  path  between  the  two 
points. 


The  protocol  controls  message  delays  by  routing  nessages  through  the  nodes 
that  have  the  smallest  operating  capacities.  Congestion  control  and  ndnisum 
hep  path  routing  are  obtained  by  using  hop  distance  (the  ruber  of  relays 
required  +  1)  as  the  primary  cost  and  path  capacity  as  the  secondary  cost 
where  the  path  capacity  is  the  sum  of  the  capacities  of  the  nodes  used  in 
routing. 

A  graphics  s imitation  program  was  developed.  The  program  is  used  to 
generate  various  node  deployment  configurations.  Each  configuration  of 
nodes  has  a  network  connect ivity  which  is  randomly  generated.  User 
cfetermined  needlines  are  established  and  distributed  routing  of  messages  is 
graphically  demonstrated. 


3.1  Link  Post 

Moquillan,  Richer,  and  Rosen  [5]  used  the  packet  delay  as  the  lilk  cost  for 
the  new  routing  algorithm  for  the  ARPANET.  However,  they  report  that  "The 
new  algorithm  tends  to  route  traffic  on  ndninun  hep  paths,  . ..  ".  He  can 
use  their  conclusion  to  use  the  hop  as  the  link  cost  instead  of  using  the 
actual  delay  measurements.  But  the  minimum-hep  path  routing  isn’t  always  an 
optimum  routing  because  it  doesn't  take  into  account  instantaneous  or  local 
variations  in  traffic  conditions. 

The  BRP  uses  the  capacity  requirements  of  the  nodes  to  determine  and  react 
to  the  traffic  conditions.  The  capacity  requirement  of  a  node  can  be  found 
from  the  original  transmit  (OT)  timeslot  require ne nts .  (The  expected  number 
of  timeslots  required  during  an  epoch /cycle  for  a  line-of-eic^Tt  needline 
traramdssion  is  the  OT  timeslot  requirement.) 

A  node  can  serve  as  a  message  origination,  destination,  or  relay  point,  or 
ary  conbiration  of  them.  If  a  node  serves  only  as  a  message  origi ration  or 
destination  point  its  capacity  requirement  is  the  OT  timeslot  requirement. 
The  capacity  recuirement  of  a  relay  is  twioe  the  OT  timeslot  requirement. 
Similarly,  the  capacity  requirement  of  a  node  serving  as  a  aenbi ration  of 
message  cried  ration,  destination,  and  relay  point  car  be  computed. 

Ar  algorithm  can  be  implemented  which  rot  only  seeks  to  find  a  minimum-hep 
path  routine,  but  also  to  balance  the  capacity  lead  among  the  nod-*?  in  the 


network.  BRP  uses  the  ndniiim-hqp  distance  dete  miration  first  and  the 
nrimnum-capacity  dist :  ice  determination  second  with  each  node  encountered 
ckiring  the  routing. 

Consider  Pig.  3-1 .  The  istwrk  connectivity  is  illustrated  in  Pig.  3-la. 
The  capacity  xequizenert  associated  with  each  link  is  as  illustrated  in  Fig. 
3-lb.  Three  possible  paths  exist  between  node  A  and  node  B  as  illustrated 
in  Fig.  3~lc. 


Route 

Hap  Distance 

1 

3 

2 

3 

3 

4 

Table  3-1 .  Hops  Required  for  Each  Route 


Referring  to  Table  3-1  route  3  is  rejected  because  it  does  not  satiety  the 
mirarauan-hcp-path  requirement. 


Route  No. 

Liric  1 

Liric  2 

Liric  3 

TOTAL 

1 

1 

1 

1 

3 

2 

1 

2 

1 

4 

Table  3-2.  Capacity  Distance  Table 


Althorgh  the  hep  distances  for  route  1  and  route  2  are  equal,  the  capacity 
distances  are  different,  as  shown  in  Table  3-2.  Route  1  would  be  the 
logical  renting  choice  to  satiety  the  node  A  -  node  B  needline.  (Mote  that 
the  liric  waists  represent  capacity  requixeaehts  (coats)  and  not  capacity 
availability. ) 

The  next  section  investigates  two  problem  in  connection  with  graphs*  the 
miniman  total  branch  cost  problem  and  the  ndninum  path  cost  problem.  The 
second  problem  is  of  particular  interest  because  the  problem  with 
finding  the  path  of  adrdaun  total  length  between  two  given  nodes. 
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a.  Network  Connectivity 


Figure  3-1.  A  Simple  Routing  Problem 
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3.2  Graph  Theory  and  Routing 

In  this  section,  a  discussion  of  graph  theory  precedes  the  discussion  of  the 
minimum  total  branch  cost  problem  and  the  ndnimum  path  cost  problem.  Par  a 
more  detailed  discussion  cf  graph  theory,  the  reader  is  referred  to  Gal  lager 
[13]. 

A  graph  is  represented  by  G(V,E),  where  V  is  a  set  of  vertices  (nodes)  and  E 
is  a  set  of  edges  (lirks). 

A  tree  is  a  graph  with  one  and  only  one  path  between  every  two  nodes.  A 
graph  which  has  loops,  or  a  graph  which  is  cyclic,  is  not  a  tree.  A  tree  is 
defined  as  an  acyclic  connected  graph. 

A  directed  spanning  tree  is  used  to  find  a  route  between  two  given  nodes.  A 
directed  spanning  tree  has  a  root  which  initiates  the  growth  of  the  tree. 
(The  BRP  assigns  the  message  source  as  the  root  of  the  tree).  Starting  from 
the  root,  the  tree  grows  until  the  sink  is  found  in  the  tree.  A  path 
between  the  source  and  the  silk  is  effectively  established  if  the  source  and 
the  sirk  coexist  within  the  tree. 

E.  W.  Dijkstra  [7]  produced  a  note  on  two  problems  in  connect  ion  with  graphs 
which  is  of  interest  to  our  present  discussion.  Me 'we  explored  the  two 
problems  with  the  use  of  a  aonputer  graphics  simulation.  The  results 
obtained  are  discussed  in  the  next  two  sections. 
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3.2.1  Mini—  Tbtal  Branch  oat  PmMsm 

Consider  a  situation  in  which  them  am  n  nodes,  each  Hiked  to  at  least  one 
other  node  such  that  all  nodm  am  corrected,,  either  directly  or  indirectly. 
Initially,  all  nodes  are  in  the  set 

GUISXDE  -  [node  (1).  no**  ''  ...  node  (n)L 

and  there  is  no  node  in  the  _  TMK.  Us  first  given  node  n(i)  is 
transferred  from  the  set  ounut  to  the  est  TM  such  that 

THEE  «  [n(i)3; 

n(i)  is  new  the  root  of  the  tree.  The  rest  of  the  nodes  from  the  set 
ansae  are  transferred  to  the  set  THE  in  segue  nor  and  in  such  a  winner 
that  the  node  from  the  eet  ""■—f*"*  that  ha  the  ehorteat  lirik  to  ary  of  the 
nodes  in  the  set  TICE  is  transferred  first.  With  each  transfer  of  a  node, 
the  lirk  that  ww  used  as  the  shortest  liik  became  a  branch  of  the  tree. 

If  all  nodes  are  connected,  either  directly  or  indirectly,  the  set  TFEE  will 
consist  of  n  nodes,  and  the  set  GtfSSlUK  will  be  an  eapfcy  set. 

This  algorithm  is  desired  to  gererete  a  tree  of  minimum  total  length  aeong 
n  given  nodes.  This  algorithm  is  not  of  use  to  us  because  it  does  not 
produce  a  path  of  ndniman  total  length  between  the  root  of  the  tree  and  aiy 
other  given  node.  The  algorithm,  however,  is  applicable  to  problem  like 
finding  the  procedures  for  connecting  terminals  with  a  ndnimm  total  cost. 

A  computer  graphics  simulation  program  was  used  to  demonstrate  the  algorithm 
at  work.  Mien  compared  to  the  simulation  result  found  in  Fig.  3-3,  the 
simulation  result  obtained  in  Fig.  3-2  is  clearly  a  tree  of  shorter  total 
length  connecting  the  given  30  nodes. 


Figure  3-2.  Minimum  Total  Branch  Cost 
Algorithm  Graphics  Output 


3.2.2  Minimum  Path  Post  Problem 

Consider  the  sane  situation  described  in  the  nrinimim  total  branch  cost 
problem.  Initially,  all  nodes  are  in  the  set 

OTTSIDE  =  [node  (1),  node  (2),...,  node  (n)]. 

and  there  is  no  node  in  the  set  TIEE.  The  first  given  node  n(i)  is 
transferred  from  the  set  OUTSIDE  to  the  set  TFEE  such  that 

TOE  =  [n(i)3; 

n(i)  is  now  the  root  of  the  tree.  The  rest  of  the  nodes  from  the  set 
OUTSIDE  are  transferred  to  the  set  TFEE  in  sequence  and  in  such  a  narrer 
that  the  node  from  the  set  OUTSIDE  that  has  the  shortest  distance  along  the 
existing  lirks  to  the  root  of  the  tree  is  transferred  first.  (Distance  is 
defined  as:  lirk  cost  (source,  relay  1)4-  link  cost  (relay  1,  relay  2)  4- 
...  4-  link  cost  (relay  m,  sirk).)  With  each  transfer  of  a  node,  the  lirk 
that  was  used  for  shortest  distance  and  which  wasn't  a  branch  of  the  tree 
becomes  a  branch  of  the  tree.  If  all  nodes  are  connected,  either  directly 
or  indirectly,  the  set  TFEE  will  consist  of  n  nodes,  and  the  :  at  OUTSU* 
will  be  an  empty  set. 

This  algorithm  is  used  to  find  the  path  of  minimum  total  length  between  two 
given  nodes.  For  this  algorithm  to  produce  the  desired  path,  lamer, 
either  of  the  two  given  nodes  nust  be  the  root  of  the  spanning  tree. 

The  graphics  simulation  output  in  Pig.  3-3  shows  a  spanning  tree  generated 
using  the  shortest  path  algorithm.  The  total  length  between  the  root  and 
ary  other  node  is  the  mininum  total  length  between  the  two  nodes.  Nate  that 
although  the  mininum  total  length  between  the  root  and  any  other  node  is 
achieved  with  the  use  of  the  shortest  path  algorithm,  the  total  length  of 
all  the  lirks  is  greater  for  the  tree  in  Fig.  3-3  vhen  compared  to  the  total 
length  of  all  the  lirks  far  the  tree  in  Fig.  3-2. 
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UNIFORM  DEPLOYMENT  DISTRIBUTION  -  CONNECTIVITY 


2i 


a 


When  a  path  cost  is  defined  in  tens  of  heps,  each  lirk  aost  carries  a  value 
of  unity.  The  distance  between  ary  two  given  poirts  is  the  amber  of  heps 
required  to  route  a  nessage  from  the  origination  point  to  the  destination 
poirt. 

the  hep  level  of  a  nods  indicates  the  nmber  of  hops  required  for  a  nessage 
from  the  source  to  reach  the  node .  A  ndnirtum  spanning  tree  grows  in  such  a 
■aimer  that  the  nodes  belonging  to  the  rent  hep  level  become  a  part  of  the 
ndninun  spanning  tree.  Consider  the  following  scenarios. 


Scenario  Ho.  1 .  level  1  Propagation 


branch  3  branch  1 

© - (source) - (§) 


branch  2 


T.'qtue  3-4.  Level  1  Propagation 


Referring  to  Fig.  3-4,  nodes  A,  B,  and  C  belong  to  level  1 .  they  are 
branched  to  in  node  sequence  of  A,  B,  and  C,  because  the  node  capacities 

Capacity  cost  (node  A)  *  1 
Opacity  cost  (node  B)  *  2 
Opacity  cost  (node  C)  ~  3 
Capacity  cost  (source)  ~  1 


Scenario  Mo.  2.  Level  2  Propagation 


Referrring  to  Fig.  3-5,  the  nodes  that  belong  to  level  2  are  node  D  and  the 
sink.  The  node  capacities  axe 

Capacity  cost  (node  D)  =  1 
Capacity  cost  (sirk)  =  1 

The  source,  having  couple  ted  the  level  1  phase,  requests  nodes  A,  B,  and  C 
to  submit  a  branch  of  opportunity.  Node  A  has  3  links  to  choose  from: 

0Q(  A, source) 

OD(A,B) 

CQ(A,D). 

The  litks  associated  with  CQ(A,  source)  and  OQ(A,B)  axe  rejected  because  the 
source  and  node  B  belong  to  the  set  TFEE  =  [source.  A,  B,  C]  indicated  by  a 
flag.  Node  D  associated  with  the  retraining  lirk  OQ(A,D)  is  chosen  as  the 
preferred  neighbor  of  opportunity  and  the  following  assignients  axe  sate: 

Hep  distance  (source,  D)  - >  SHORT  (node  A) 

Capacity  distance  (source,  D)  - >  LESS  (node  A) 

node  D  - >  BETTER  (node  A) 

Node  A  submits  the  three  variable  assignments  to  the  source. 

Next  consider  the  equivalent  processing  at  node  B.  Node  B  ctetects  the 
presence  of  the  sirk,  requests  the  sirk  to  submit  data,  and  the 

following  assignments. 

Hep  distance  (source,  silk)  - >  SHORT  (node  B) 

Capacity  distance  (source,  sirk)  - >  less  (node  B) 

six*  - >  BETTER  (node  B) 

Note  B  submits  the  three  variable  assignments  to  the  source. 

Finally,  consider  the  equivalent  processing  undertaken  at  node  C.  Node  C 
detects  the  presence  of  the  sirk,  requests  the  sirk  to  submit  data,  and 
■rakes  the  following  assignments: 

Hep  distance  (source,  sirk)  - >  SHORT  (node  C) 

Capacity  distance  (source,  sirk)  - >  LESS  (node  C) 

sirk  - >  BETTER  (node  C) 

The  source,  therefore,  receives  the  inf  crest 'ion  submitted  by  all  peripteral 
notes  of  the  mininum  spanning  tree  (BMST)  and  finds  that  a  sirk  detection 
has  occurred.  The  infenration  submitted  by  note  A  is  discarded  because  the 
internet  ion  does  not  pertain  to  the  detected  sirk.  However,  the  source  has 
two  paths  to  the  sirk  to  choose  from,  both  of  which  are  of  the  hep 


22 


distance.  An  obvious  choice  would  be  the  path  that  has  the  least  expected 
congestion.  Table  3-3  illustrates  the  capacities  that  cue  involved. 


CAPACITY  COSTS  1 

Route 

Source 

Relay 

Sink 

TOTAL 

Source-B-Sirk 

1 

2 

1 

4 

Source -C-Sirk 

1 

3 

1 

5 

Table  3-3.  Capacity  Distance  Table 


The  source  chooses  the  Source -B-Sirk  path  because  the  capacity  cost  of  the 
Source -B-S irk  path  is  less  than  the  capacity  cost  of  the  Source -C-Sirk  path. 

Fig.  3-6  illustrates  the  decision  process  occurring  at  the  root  of  a  ndnicun 
spanning  tree.  Fig.  3-7  illustrates  the  decision  process  occurring  at  a 
peripheral  node  of  a  minimum  spanning  tree.  The  two  processes  are 
coordinated  for  the  growth  of  a  ndninum  spanning  tree. 
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Figure  3-6.  Decision  Process  at  the  Root 
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Figure  3-7.  Decision  Process  at  a  Peripheral  Node 
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3.4  Routing  List 

A  routing  list  is  a  sequenced  list  of  the  nodes  required  to  construct  a 
route  frail  the  source  to  the  destination,  starting  with  the  scurae  terminal 
I.D.  No.  and  ending  with  the  terminal  I.D.  No.  of  the  destination. 

© - 0 - © 

Figure  3-8.  A  3-node  Linear  Network 


A  ndninum  spanning  tree  with  the  source  as  its  root  searthas  for  the  sink 
through  a  growth  process.  At  ary  tine  prior  to  sink  detection  it  is 
essential  for  the  source  to  keep  a  complete  knowlege  of  the  routing 
requirements  of  all  PtWETs.  Consider  the  network  in  Fig.  3-8. 

Node  A  is  the  source  and  node  C  is  the  PNMST.  The  source  Bay  keep  the 
following  routing  lists: 

List  (A)  =  [A] 

List  (B)  =  [A,B] 

List  (C)  *  [A.B.C] 

To  reduce  the  memory  requirements  of  the  source,  however,  the  source  keeps 
only  the  routing  list  of  the  PNCT.  Consider  the  network  in  Fig.  3-9. 


® - © - 1  Source) - © - © 

Figure  3-9.  A  7-node  Network 


the  source  keeps  the  following  routing  lists: 


List  (B)  *=  [ Source,  A,B} 
List  (D)  =  [Source, C,D] 
List  (F)  =  [ScuroefE,F] 


The  source  does  not  keep  list  (C),  list  (A),  and  list  (E). 


3.5  Routing  Failure 

A  loss  of  a  route  can  occur  »*en  a  Ices  of  connectivity  is  experienced.  A 
routing  failure  can  be  avoided  if  a  loss  of  route  is  detected  and  corrected 
by  having  the  source  reinitiate  the  routing  procedure.  The  key  to  detection 
is  the  routing  list. 

0 - 0 - 0 - 0 

Figure  3-10.  4-node  Linear  Network 


Consider  the  network  in  Fig.  3-1'i.  Mode  A  has  a  route  to  node  D  as  follows: 
A  -  B  -  C  -  D.  Node  A  sends  its  sessage  with  the  routing  list 

List  (D)  =  [A  B.C.D]- 

Node  B  receives  the  Message  and  sends  it  to  C.  Node  C  receives  the  sessage* 
determines  that  the  next  node  in  sequence  is  node  D,  but  finds  that  the  link 
CXXC.D)  no  longer  exists.  It  returns  a  new  routing  list  of 

List  (A)  -  [C,B,A] 

which  has  the  reverse  sequence  of  [A,B,C] .  When  node  A  receives  the  sessage 
it  reinitiates  its  routing  procedure  to  find  an  alternate  path  to  node  D. 


3.6  Multiple  Needlines  from  a  Cannon  Source 

It  was  previously  stated  that  a  routing  procedure  is  initiated  upon 
realizing  a  needline.  This  inplies  that  a  separate  minimum  spanning  tree  is 
initiated  for  each  needline.  However,  a  reduction  in  the  tine  it  takes  to 
initialize  the  network  can  be  achieved  when  a  aontnon  tree  is  used  for 
needlines  from  a  canton  source.  Under  this  scheme,  the  mimnun  spanning 
tree  propagation  is  halted  when  the  ruder  of  sirks  that  are  located  is 
equal  to  the  natter  of  needlines  originating  from  the  cannon  source. 


3.7  Sinultaneous  Occurrence  of  Miniaun  Spanning  Trees 


As  described  previously,  the  variables  used  by  the  BRP  are  not  capable  of 
handling  a  simultaneous  occurrence  of  minimart  spanning  trees.  There  are  two 
solutions  to  the  problem,  each  with  its  achentages. 


Solution  No.  1 : 


All  variables  will  be  modified  to  acccnrodate  a  tew  array  argument  that 
identifies  the  mininum  spanning  tree  that  each  variable  pertains  to.  This 
method  achieves  the  capability  for  handling  siirultaneous  occurrence  of 
mininum  spanning  trees  at  a  cost  of  an  increased  neunry  requirement  of  the 
terminal  processors. 

Solution  No.  2: 


No  modifi  cation  of  the  existing  variables  is  required  but  the  occurrence  of 
the  mininuiN  spanning  trees  is  sequentially  orchestrated  so  that  no  two 
mininum  spanning  trees  intersect  a  node  at  ary  given  tine.  This  method 
achieves  a  substantial  reduction  of  the  memory  requirement  of  the  processors 
at  a  cost  of  taking  longer  to  initialize  the  network. 


3.8  BKP  Simulation  Results 

A  graphics  simulation  program  was  developed  to  observe  the  state  of  a 
network  as  a  function  of  time.  The  program  is  capable  of  deploying  up  to 
300  nodes  using  any  of  the  four  random  distributions: 

1.  uniform 

2.  gauss ian 

3.  Poisson 

4.  exponential 

Network  connectivity  matrix  can  be  randomly  generated:  each  node -to— node 
connectivity  quality  (OQ)  is  described  by  a  4-ary  quality  field  generated  by 
an  exponential  distribution  random  timber  generator.  The  user  controls  the 
average  degree  per  node  so  that  a  wide  range  of  network,  connectivities  can 
be  generated. 

Although  there  can  exist  any  timber  of  needlines  in  a  network,  as  long  as 
the  timber  does  not  exceed  n(n-l),  where  n  is  the  amber  of  nodes  in  the 
network,  far  the  purpose  of  obtaining  a  clear  visual  understanding  of  the 
graphics  demonstrations  we  use  a  snail  rarnber  of  needlines. 

Fig.  3-11  shows  the  connectivity  of  a  network  of  30  randomly  deployed  nodes. 
Figs.  3-12  and  3-13  show  the  reedlines  used  and  the  routes  established  to 
satisfy  the  needlines.  We  find  that  all  paths  are  mininum-hop  paths. 
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UNIFORM  DEPLOYMENT  DISTRIBUTION  -  CONNECTIVITY 


UNIFORM  DEPLOYMENT  DISTRIBUTION  -  NEEDLINES 


Figure  3-12.  BRP  Simulation  Output 
for  6  Need lines 
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UNIFORM  DEPLOYMENT  DISTRIBUTION  -  NEEDLINES 


Figure  3-13.  BRP  Simulation  Output 
for  3  Need lines 
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4.0  EARLY  EETECTICN  ROUTING  PROTOCOL 

The  early  detection  routing  protocol  (EDRP)  uses  the  BRP  and  the  oonnnniaant 
status  (level  0)  messages  (CSM3)  to  achieve  distributed  routing.  Althouc£i 
the  BRP  is  sufficient  to  route  messages,  when  CSMSs  are  used  nuch  of  the 
information  acquisition  in  distributed  routing  is  achieved  without  the  use 
of  interrogat  ions . 


4.1  Oamunicant  Status  (level  0)  Message 

A  cornu  meant  status  (level  0)  message  (CSM0)  is  a  control  message  which  is 
periodically  broadcast  by  each  terminal.  It  lists  the  connectivity 
qualities  (CDs)  of  the  broadcaster's  direct  aortnjni carts .  A  node  that 
receives  CSKJs  not  only  knows  the  CDs  of  its  direct  ooraminicaribs,  but  it 
also  knows  the  CDs  of  the  direct  aomnunioants  of  its  direct  ccuiruni carts 
through  the  use  of  its  terminal  connectivity  natriz  (TOl) . 


©±©±© 

3  1 

Figure  4-1 .  A  3-node  Linear  Network 


Consider  the  network  in  Fig.  4-1 .  Nodes  A,  B,  and  C  enter  the  net  in 
sequence.  Upon  entering  the  net  each  node  regularly  broadcasts  and  receives 
a  CSM0.  With  each  reception  of  a  CSM0  each  node  updates  its  terminal 
connectivity  natrix  (TCM)  and  its  CSM0  broadcasts.  Tahle  4-1  swnarises  the 
conplete  upeferte  events  of  the  CSM3  broadcasts  that  occur. 


Count 

Sender 

gq(a,b) 

OQ(B,A) 

OQ(B,C) 

CQ(C,B) 

n 

A 

B 

2 

A 

2 

3 

BK 

B 

2 

3 

C 

3 

’■Im 

B 

2 

3 

3 

1 

Kjff 

C 

3 

1 

Table  4-1 .  Ccmrunicart  Status  (level  0)  Messages 


The  CSM0  that  a  node  receives  is  used  to  update  the  node  TCM.  With  enough 
updates,  the  node  gains  a  oonplete  bidirectional  OQ  knowledge  of  all  links 
within  two  heps  frem  the  node . 


4.2  Terminal  Connectivity  Matrix 

The  connectivity  data  base  of  a  terminal  is  a  matrix  referred  to  as  the 
Terminal  Connectivity  Matrix  (TCM)  Which  is  contained  in  each  TO&  terminal. 
(To  be  const  is  tent  with  the  rest  of  the  text,  it  should  be  pointed  out  that 
the  words  "terminal"  and  "node "  are  used  interchangeably  in  this  section. ) 
The  TCM  is  used  to  store  information  cm  ary  terminal's  connectivity  with 
other  netted  terminals .  Since,  in  a  non-lire -of -sic^rt  enviroment,  the 
connectivity  of  a  particular  terminal  to  other  terminals  in  the  net  is 
incomplete,  each  terminal  will  have  a  TCM  Which  is  said  to  be  local. 

Using  Fig.  4— 2b  as  the  reference  we  make  the  following  observations: 

1)  The  matrix  is  symmetric  in  the  sense  that  if  OQ(i,  j)  is  a  nonzero 
entry  then  OQ(j,i)  is  also  a  nonzero  entry.  The  symmetry  of  the 
matrix  allows  us  to  analyze  the  data  by  locking  only  at  the  upper 
diagonal  matrix  (UCM). 

2)  The  entries  of  the  first  row  of  UEM  tell  us  that  terminals  2,  3, 
and  4  are  the  direct  communicants  of  terminal  1. 

3)  The  entries  of  the  eeoond  and  fourth  row  of  UDM  tell  us  that 
terminals  5,  6,  and  7  are  the  indirect  communicants  of  terminal  1. 

To  establish  the  terminal  1  -  indirect  communicant  communications 
lirks,  the  following  routing  arrangements  are  necessary: 

a.  1-2-7 

b.  1-4-5 

c.  1-4-6 
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LINKS  BETWEEN  TERMINALS 

a.  A  Network  of  10  Nodes 


12345  6789  10 


4.3  Early  Detection 

Early  detection  of  the  sirk  occurs  in  two  phases.  A  PfcHST  will  detect  the 
side  in  the  following  r  nrer: 

1)  A  WHETT  first  detects  the  presence  of  the  sirit  two  heps  away  from  the 
mini nuin  spanning  tree. 

2)  The  P*MST  later  detects  the  presence  of  the  sink  one  hep  away  from  the 
arimmin  spanning  tree. 


4.3.1  First  level  Early  Detection  (FLIP) 

When  Fill)  occurs,  the  PIW5T  that  detects  the  sirk  chooses  the  sink  as  its 
preferred  nei^bor  of  opportunity,  interrogates  the  silk  for  its  node 
capacity,  and  halts  its  infamution  gathering  process.  The  PNMST  submits 
the  hranch-of -opportunity  data  to  the  source. 

The  source,  however,  does  not  halt  its  information  processing  upon  receiving 
the  cfcta  containing  the  sirk  information,  because  there  nay  be  other 
i nooning  data  also  containing  the  sirk  information  which  nay  indicate  a 
better  route  to  the  sirk.  The  source  gathers  all  branch-of -opportunity  data 
submitted  by  each  PNM5T,  rejects  the  bra nch-of -opportunity  data  not 
containing  the  sirk  inf  cruet  ion  (if  a  sirk  data  exists  within  the  set  of 
submitted  data),  and  selects  the  best  choice  among  the  remaining  data.  The 
reader  is  referred  to  the  bad  flowcharts  for  details  of  the  decisions 
involved  in  the  algorithm. 


4.3.2  SeoTnd  level  Early  Detection  (SLED) 

When  SLED  occurs,  the  PMfTT  that  detects  the  sirk  two  heps  away  from  itself 
chooses  the  direct  centre ni cart  which  is  a  direct  aomrenicart  of  the  sink  as 
its  preferred  neighbor  of  opportunity,  but  unlike  in  the  previous  case,  the 
informt icn  gathering  process  centimes  until  either  FLED  occurs  or  the 
1  irks  to  he  considered  have  been  depleted.  The  P»ET  requests  the  preferred 
neichbor  of  opportunity  fear  the  node  capacity,  and  submits  the 
bra ndh-of -opportunity  data  to  the  source. 

The  source  gathers  the  data  submitted  by  each  PWET,  rejects  the  branches  of 
opportunity  not  indicated  by  SLET,  and  selects  the  best  dKtiae  anong  the 
reirainirg  data. 


It  is  possible  that  FLED  and  SLED  can  simultaneously  occur  for  a  given 
submit  recuest  cycle.  Kcwever,  they* can  also  occur  similtarecusly  during 
the  infernal  ion  gathering  process  of  a  PKMST.  A  PCUST  may  detect  the  sirk 


two  heps  away  from  itself,  but  the  inportanoe  of  the  detection  is  only 
second  to  the  inportanoe  of  FLJED,  therefore  the  SLED  algorithm  exists 
seperate  from  the  FLED  algorithm  and  takes  second  priority  to  the  FLED 
algorithm. 


4.3.3  Early  Detection  Algorithm 

Early  detection  can  be  achieved  by  methodically  searching  throucfi  the 
termiral  connectivity  matrices  of  each  Pt#©T  for  the  sink  entry.  Far 
simplicity,  we  will  assume  that  all  links  are  undirected,  which  implies  that 
all  TOMs  are  symmetric  in  the  sense  that  if  there  exist  a  nonzero  OQ(i,  j) 
entry,  then  there  exists  a  nonzero  OC(  j,  i)  entry  regardless  of  the  actual  OQ 
values. 

Referring  to  the  TCM  of  Fig.  4- 2b  which  is  the  connectivity  data  base  of 
terminal  1  (found  in  Fig.  4— 2a),  we  will  assume  the  following* 

1)  All  lirks  are  undirected. 

2)  Terminal  1  is  the  source. 

If  we  define  an  entry  O0{i,  j)  as  the  connectivity  quality  of  the  lirk  i-j  in 
the  direction  going  from  i  to  j,  then  we  can  ignore  the  lower  diagonal 
entries  of  the  TCM  and  work  only  with  the  upper  diagonal  matrix  (LEM) 
because  the  entries  of  the  IDM  represent  the  connectivities  of  the  reverse 
paths. 


Locking  at  the  first  row  entries,  terminals  2,  3,  and  4  are  terminal  l's 
direct  onmnunxeants.  If  any  of  the  terminals  is  the  sink,  then  FLED  has 
occurred. 


Looking  at  the  entries  of  the  second  and  fourth  raws,  terndrals  5,  6,  and  7 
are  the  indirect  oonmunioarts  of  terminal  1.  If  any  of  the  terminals  is  the 
sink,  then  SU2)  has  occurred.  For  terminal  1,  node  4,  4,  or  2  is  the 
preferred  neighbor  of  opportunity  if  node  5,  6,  or  7  is  the  siik, 
respectively. 
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4.4  EEFP  Simulation  Results 


A  graphics  EDSP  sinulation  program  was  developed  which  has  the  sane  user 
interaction  format  as  the  BRP  sinulation  program.  The  reader  is  referred  to 
>  the  appendix  far  a  full  description  of  the  program. 

Fig.  4-3  shows  the  connectivity  of  a  17x17  Jtuhattan  network.  Fig.  4-4 
shows  the  needlines  used  and  the  routes  established  to  satisfy  the 
needlines. 

Fig.  4-5  shows  the  connectivity  of  a  network  of  300  randomly  deployed  nodes. 
Figs.  4-6  and  4-7  show  the  needlines  used  and  the  routes  established  to 
satisfy  the  needlines. 

As  expected,  all  paths  shown  axe  ndninumhcp  and  mirmaso-capacity  paths. 

This  means  that  it  is  possible  to  maintain  a  uniform  capacity  distributed 
network  that  is  capable  of  failsafe  distributed  routing. 
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Figure  4-4.  EDRP  Graphics  Output  for  a 
Manhattan  Network 
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UMirOQM  DCBLOVMCMT  QICTQIDUTIOM  -  CONNECTIVITY 


Fiqure  4-5.  Network  Connectivity 
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UNIFORM  DEPLOYMENT  DISTRIBUTION  -  NEEDLINES 


Figure  4-6.  EERP  Graphics  Output  for  a 
Random  Deployment  of  Nodes 
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UNIFORM  DEPLOYMENT  DISTRIBUTION  -  NEEDLINES 


Figure  4-7.  EDRP  Graphics  Output  for  a 
Random  Deployment  of  Nodes 
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5.0  OCNCIUSICNS 


We  graphics  siaulaticn  results  shew  that  the  EDRP  weeks  fee  nuy  different 
networks.  The  paths  that  were  generated  to  satisfy  the  reedlines  were 
consistently  ndmnun-hcp  and  nd ni w an-capacity  paths. 

An  exciting  avenue  of  approach  towards  achieving  an  cptisun  timeslot 
allocation  in  TUA  networks  exists  as  indicated  by  Skiscim  [10] .  This 
approach,  unlike  the  commodity  flow  approach  that  we've  taken,  seeks  to 
optimise  the  throueftput  by  locking  at  the  individual  traffic  conditions  for 
each  timeslot.  As  part  of  our  ongoing  research  we  will  consider  this 
approach,  first  looking  at  it  from  the  theoretical  point  of  view,  and  then 
assessing  its  isplesentahility  based  upon  the  parameter  constraints  of  a 
typical  digital  broadcast  network. 

Currently,  the  authors  axe  involved  in  an  ongoing  effort  to  develop  a 
simulation  tool  far  the  network  wager  of  a  battlefield  data  distribution 
system.  The  simulation  tool  is  envisioned  to  be  capable  of  cptisun  routing, 
cptisun  capacity  distribution,  adapting  to  topological  changes,  and  reacting 
to  changes  in  the  ooominicBticne  needs  of  the  net  subscribers. 
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APPENDIX 


EDBP  Graphics  Sjaulation 

An  EDRP  graphics  simulation  program  was  developed  at  the  cvNfm  System 
Simulations  Facility  using  the  ReGIS  Graphics  Library.  The  VAX  FORTRAN 
program  runs  on  a  VAX  11/780  oonputer  with  the  VT125  terminal  used  for  user 
interaction. 

The  program  is  divided  into  several  segnents:  deployment  of  the  nodes, 
generation  of  the  network  connectivity,  generation  of  a  set  of  desired 
reedlines,  and  routing  execution.  The  routing  scenario  can  he  printed  out 
cm  a  graphics  printer  along  with  the  deployment,  connectivity,  and  needline 
scenarios. 

In  the  deployment  segment  of  the  program,  the  user  chooses  a  uniform, 
gauss ian,  Poisson,  cr  exponential  node  deployment  distribution,  for  a  user 
interested  in  a  theoretical  research  in  network  nanagenent  there  is 
available  a  Manhattan  network  qption  which  produces  an  ran  grid  network, 
where  n  is  an  integer  specified  by  the  user.  The  muter  of  nodes  in  the 
network  ranges  from  1  to  300. 

In  the  network  connectivity  segment,  the  program  generates  a  random  network 
connectivity  using  the  exponential  distribution  function  niter  generator. 
(The  exponential  distribution  function  has  a  parameter  Lambda  which 
determines  the  spread  of  the  connectivity  likelihood  region. )  The  user 
specifies  the  expected  degree  of  a  node.  The  user  can  produce  a 
connectivity  rich  network  by  specifying  a  large  expected  degree  value,  cr  a 
connectivity  poor  network  (or  even  a  disconnected  network)  by  specifying  a 
email  expected  degree  value. 

In  the  needlines  segment,  the  program  generates  a  random  pattern  of 
needlires  using  the  uniform  distribution  function  nmber  generator.  The 
user  specifies  the  runber  of  needlines  to  be  used,  but  the  program  does  not 
generate  note  than  n(n-l)  needlines,  there  n  is  the  nmber  of  nodes 
deployed.  It  is  also  possible  to  generate  needlines  with  the  use  of  a 
graphics  cursor.  The  user  controls  the  cursor  movement  with  the  use  of  the 
arrow  keys  on  the  keyboard. 

There  is  a  segment  that  graphically  demonstrates  the  shortest-path  algorithm 
which  produces  a  minimum-spanning  tree  rooted  at  a  node  which  the  user 
specifies,  for  clarity  in  analyzing  the  results,  the  physical  dintawna.  that 
seperates  each  pair  of  nodes  is  taken  as  the  liik  cost.  The  results  of  an 
execution  of  the  algorithm  are  strongly  influenced  by  the  network 
connectivity  that  is  used,  so  the  segrert  can  be  a  valuable  tool  for  a  user 
vho  is  interested  in  investigating  the  effects  of  differing  network 
connectivity  on  network  nanagenent. 


45 


Finally,  there  is  a  serpent  which  graphically  demonstrates  the  distributed 
routing  of  messages  using  the  EDBP.  There  is  no  irput  parameter  that  the 
user  needs  to  specify.  The  parameters  that  are  used  are  the  deployment, 
connect ivity ,  and  needline  (feta  that  were  previously  generated  and  stoned  in 
variable  arrays. 

The  authors  are  in  the  process  of  upgrading  the  EDRP  graphics  simulation 
progran.  The  program  listing  is  not  available  for  distribution  at  this 
tins. 
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LIST  OF  AOOK>6 


EBP 

OD 

CSM3 

EDBP 

FLED 

JTTDS 

UM 

or 

KFH 

PWBT 

SIB) 

TCM 

TDMV 

TS/S 

DEM 


basic  routing  protocol 

connectivity  quality 

cormurucarit  status  message  (level  0) 

early  detection  routing  protocol 

first  level  early  detection 

Joint  Tactical  Information  Distribution  System 

lower  diagonal  matrix 

original  transmit 

PLBS/JTIDS  Hybrid 

peripheral  node  of  the  mininum  spanning  tree 

second  level  early  detection 

terndnal  connectivity  matrix 

time  division  multiple  access 

timeslots  per  second 

upper  diagonal  matrix 
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